Method of providing voice command and electronic device supporting the same

ABSTRACT

Disclosed is a portable communication device, including a display, at least one microphone, a memory, and a processor operably connected to the display, the at least one microphone and the memory, wherein the processor is configured to display guide information, via the display, in response to a user input, the guide information including a first display object related to guide a user voice input for generation of a new voice command and a second display object related to at least one application executed by the new voice command via the portable communication device, receive audio data corresponding to the first display object from a user through the at least one microphone, generate the new voice command corresponding to the audio data, and store, in the memory, the new voice command corresponding to the received audio data and mapping information indicating that the new voice command and the at least one application are mapped.

PRIORITY

This application is a Continuation of, and claims priority under 35U.S.C. § 120 to, U.S. patent application Ser. No. 16/895,499, which wasfiled in the USPTO on Jun. 8, 2020, which is a Continuation of, andclaims priority under 35 U.S.C. § 120 to, U.S. patent application Ser.No. 15/906,594, which was filed in the USPTO on Feb. 27, 2018, issued asU.S. Pat. No. 10,679,619 on Jun. 9, 2020, which is a Continuation of,and claims priority under 35 U.S.C. § 120 to, U.S. patent applicationSer. No. 14/755,441, which was filed in the USPTO on Jun. 30, 2015,issued as U.S. Pat. No. 9,934,781 on Apr. 3, 2018, and claims priorityunder 35 U.S.C. § 119(a) to a Korean Patent Application Serial No.10-2014-0080541, which was filed in the Korean Intellectual PropertyOffice on Jun. 30, 2014, the entire content of each of which isincorporated herein by reference.

BACKGROUND 1. Field of the Disclosure

The present disclosure relates to a method and electronic device forproviding a voice command, and more particularly to a method andelectronic device for converting audio data into a voice command toinstantly process a function without a delay due to server managementwhen the audio data satisfies a specific condition.

2. Description of the Related Art

With the recent development of digital technology, various mobileelectronic devices (for example, mobile communication devices, PersonalDigital Assistants (PDAs), smartphones, tablet Personal Computers (PCs),and so on) capable of processing communication and personal informationare available. Such electronic devices are equipped with a speechrecognition function. Accordingly, when a user inputs voice, the relatedart electronic device may recognize the voice and output a recognitionresult.

Moreover, an electronic device performs server device management inorder to improve the reliability of a speech recognition result.Accordingly, in relation to using a speech recognition function, anelectronic device performs an operation for transmitting voice data to aserver device and receiving information corresponding thereto. Duringthis operation, the electronic device may experience significant delay.The delay may cause inconvenience during repeated operation of a speechrecognition function.

SUMMARY

The present disclosure has been made to address the above-mentionedproblems and disadvantages, and to provide at least the advantagesdescribed below.

Accordingly, an aspect of the present disclosure provides a voicecommand providing method for converting audio data into a voice commandto instantly process a function without a delay due to server managementwhen the audio data satisfies a condition and an electronic devicesupporting the same.

In accordance with an aspect of the present disclosure, a portablecommunication device includes a display, at least one microphone, amemory, and a processor operably connected to the display, the at leastone microphone and the memory, wherein the processor is configured todisplay guide information, via the display, in response to a user input,the guide information including a first display object related to guidea user voice input for generation of a new voice command and a seconddisplay object related to at least one application executed by the newvoice command via the portable communication device, receive audio datacorresponding to the first display object from a user through the atleast one microphone, generate the new voice command corresponding tothe audio data, and store, in the memory, the new voice commandcorresponding to the received audio data and mapping informationindicating that the new voice command and the at least one applicationare mapped.

In accordance with another aspect of the present disclosure, a methodfor operating a new voice command by a portable communication deviceincludes displaying guide information, via a display, in response to auser input, the guide information including a first display objectrelated to generation of a new voice command and a second display objectrelated to at least one application executed by the new voice commandvia the portable communication device, receiving audio datacorresponding to the first display object from a user through at leastone microphone, generating the new voice command corresponding to theaudio data; and storing, in a memory, the new voice commandcorresponding to the received audio data and mapping informationindicating that the new voice command and the at least one applicationare mapped.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of the presentdisclosure will be more apparent from the following description, takenin conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram of a voice command providing system accordingto an embodiment of the present disclosure;

FIG. 2 is a block diagram of a control module and a storage moduleaccording to an embodiment of the present disclosure;

FIG. 3 is a block diagram of a server device according to an embodimentof the present disclosure;

FIG. 4 is a block diagram relating to voice command processing accordingto an embodiment of the present disclosure;

FIG. 5 is a flowchart of a voice command providing method according toan embodiment of the present disclosure;

FIG. 6 is a flowchart of a voice command providing method according toan embodiment of the present disclosure;

FIG. 7 is a flowchart of a voice command provision related candidaterecognition model processing method according to an embodiment of thepresent disclosure;

FIG. 8 is an illustration of a user interface relating to a voicecommand provision according to an embodiment of the present disclosure;and

FIG. 9 is a block diagram of an electronic device according to anembodiment of the present disclosure.

DETAILED DESCRIPTION

Hereinafter, an electronic device according to various embodiments ofthe present disclosure is described in more detail with reference to theaccompanying drawings. Various modifications are possible in variousembodiments of the present disclosure and specific embodiments areillustrated in the accompanying drawings and related detaileddescriptions are provided. However, this does not limit the variousembodiments of the present disclosure to a specific embodiment and itshould be understood that the present disclosure covers allmodifications, equivalents, and/or replacements of this disclosureprovided they are within the scope of the appended claims and theirequivalents. With respect to the descriptions of the accompanyingdrawings, like reference numerals refer to like elements.

FIG. 1 is a block diagram of a voice command providing system accordingto an embodiment of the present disclosure.

Referring to FIG. 1, a voice command providing system 10 includes anelectronic device 100, a network 300, and a server device 200.

The voice command providing system 10 of such a configuration transmitsaudio data, collected by the electronic device 100, to the server device200 through the network 300. The server device 200 transmits analysisdata of audio data to the electronic device 100. The electronic device100 registers specific audio data as a voice command on the basis of thereceived audio analysis data (for example, audio feature data, speechrecognition data, function execution data (or function performancedata), and so on). If audio data relating to a voice command iscollected, the electronic device 100 performs a function (e.g. voiceshort-cut) for the voice command separately from the server device 200.The above-mentioned voice command providing system 10 supports a promptfunction call (for example, search, execution, activation, ordeactivation) by registering specific audio data as an instruction inrelation to a specific function execution of the electronic device 100.Additionally, the voice command providing system 10 may establish avoice command architecture (or system) substantially by converting arecent frequently used function as a voice command according to ahistory of audio data that a user of the electronic device 100 inputsand managing the voice command. Additionally, the voice commandproviding system 10 may efficiently manage the voice commandarchitecture (or system) by removing an unused voice command.

The network 300 supports a communication channel establishment betweenthe electronic device 100 and the server device 200. The network 300 maybe prepared with a network device element capable of supporting acommunication method of at least one communication module prepared inthe electronic device 100. For example, the network 300 may include acellular communication related network device element (for example, amobile base station, a mobile switching center, etc.), a WirelessFidelity (WiFi) communication related network device element (forexample, an Access Point (AP), a core network, etc.), and the like. Thenetwork 300 is not limited to a specific device element. The network 300may be prepared with at least one device element that establishes atleast one communication channel available for transmission of audio dataand transmission of audio analysis data between the electronic device100 and the server device 200. According to an embodiment of the presentdisclosure, if a communication channel is established through ashort-range wireless communication method or a direct communicationmethod (e.g. a method of directly establishing a communication channelwithout passing through a base station), the network 300 may be omitted.An example of transmitting/receiving data on the basis of a form ofincluding the network 300 is described below.

The server device 200 establishes a communication channel with theelectronic device 100 through the network 300. According to anembodiment of the present disclosure, the server device 200 establishesa data communication channel with the electronic device 100 in relationto the reception of audio data and the transmission of audio analysisdata. According to an embodiment of the present disclosure, the serverdevice 200 establishes a voice communication channel for receiving audiodata from the electronic device 100 and a data communication channel fortransmitting audio analysis data to the electronic device 100. Accordingto an embodiment of the present disclosure, the server device 200manages and provides a voice command of the electronic device 100. Forexample, the server device 200 may store information on voice commandsfor each of at least one electronic device 100 or each of at least oneuser. The server device 200 analyzes audio data that the electronicdevice 100 provides. The server device 200 may perform the deletion ofvoice commands performed on the electronic device 100 or the addition ofa new voice command on the basis of audio analysis data. When a voicecommand update occurs, the server device 200 provides voice commandupdate information to the electronic device 100.

The electronic device 100 establishes a connection with the serverdevice 100 through the network 300 and transmits audio data to theserver device 200. The electronic device 100 receives audio analysisdata from the server device 200. The electronic device 100 may generatenew voice commands or remove a pre-generated voice command on the basisof the received audio analysis data. According to an embodiment of thepresent disclosure, the electronic device 100 may update a pre-generatedvoice command on the basis of the collected audio data. According to anembodiment of the present disclosure, the electronic device 100 maygenerate a specific voice command by an input event. According to anembodiment of the present disclosure, the electronic device 100 mayreceive a specific voice command from another electronic device or theserver device 200 and store the received specific voice command. Theelectronic device 100 may update a stored voice command by using thecollected audio data or the audio analysis data that the server device200 provides. According to an embodiment of the present disclosure, theelectronic device 100 may not update by at least one of the collectedaudio data and the audio analysis data in relation to a specific voicecommand. According to an embodiment of the present disclosure, theelectronic device 100 manages a candidate recognition model relating tovoice command generation in a voice command update operation. The voicecommand may be included in a recognition model (for example, a modelincluding at least one of audio feature data and speech recognitiondata) and managed.

The above-mentioned electronic device 100 may include a communicationinterface 110, an antenna 112, an input module 120, an audio module 130,a display module 140, a storage module 150, a control module 160, and abus 170.

The communication interface 110 establishes a communication channel withthe network 300. According to an embodiment of the present disclosure,the communication interface 110 establishes a communication channel withthe network 300 according to a communication method such as 3G/4G, andso on. According to an embodiment of the present disclosure, thecommunication interface 110 establishes a communication channelaccording to a WiFi communication method via the antenna 112. Thecommunication interface 110 may establish a communication channel withthe server device 200 through the network 300. In relation to this, theelectronic device 100 may perform the connection of the server device200 by using pre-stored or inputted address information. Herein, theaddress information, as information such as an Internet Protocol (IP)address and so on, may include identification information of the serverdevice 200 registered in the network 300.

According to an embodiment of the present disclosure, when performing aspecific function (for example, a voice search function such as S-Voiceof the Samsung Galaxy, a voice search function such as Siri of the AppleiPhone, etc.) of the electronic device 100, the communication interface110 may be activated automatically. Alternatively, when audio data iscollected according to a specific function execution, the communicationinterface 110 may be activated. The communication interface 110 maytransmit the collected audio data to the server device 200. During thisoperation, the communication interface 110 may transmit identificationinformation (for example, address information of the electronic device100, phone number information of the electronic device, hardware relatedinformation of the electronic device 100 such as Media Access Control(MAC) address, etc.) of the electronic device 100.

According to an embodiment of the present disclosure, the communicationinterface 110 receives audio analysis data (for example, at least one ofaudio feature data, speech recognition data, and function execution datarelating to transmitted audio data) from the server device 200. Thecommunication interface 110 delivers the received audio analysis data toat least one of the storage module 150 and the control module 160.According to an embodiment of the present disclosure, the communicationinterface 110 receives at least one of a voice command and voice commandupdate information from the server device 200. The voice command andvoice command update information that the communication interface 110receives may be stored in the storage module 150 and the control module160 or updated.

The input module 120 generates an input signal relating to themanagement of the electronic device 100. For example, the input module120 may include a physical key button (for example, a home key, a sidekey, a power key, etc.), a jog key, a keypad, and the like. The inputmodule 120 may include a virtual keypad outputted to the display module140 as an input device. The input module 120 may generate an inputsignal relating to the execution of a specific application (app) (forexample, a voice search function, a voice command management function,etc.). According to an embodiment of the present disclosure, the inputmodule 120 generates an input signal relating to a character inputcorresponding to a specific voice command. The input module 120 maygenerate an input signal for requesting the connection from the serverdevice 200, an input signal relating to a specific voice commandreception from the server device 200, and so on. The voice command maycorrespond to a recognition model (for example, a model including atleast one of audio data, audio feature data, and speech recognitiondata).

The audio module 130 supports a function relating to the audio dataoutput and audio data collection of the electronic device 100. Inrelation to this, the audio module 130 includes a speaker for performingan audio data output and at least one microphone for supporting audiodata collection. If a specific app (for example, a voice searchfunction) of the electronic device 100 is executed, the audio module 130may be activated automatically. According to an embodiment of thepresent disclosure, if power is supplied to the electronic device 100,the audio module 130 is activated to perform audio data collection inreal time or at predetermined periods (for example, an “always on” mode,which is a mode or function in which a voice search or collectionfunction is performed as background processing). The audio data that theaudio module 130 collects may be stored in the storage module 150 or maybe transmitted to the server device 200 through the communicationinterface 110 according to a control of the control module 160.

According to an embodiment of the present disclosure, when collectingspecific audio data, the audio module 130 outputs response informationon the collected audio data. For example, as a speech recognition resultfor the collected audio data, the audio module 130 outputs informationthat describes the type of a function performed based on the speechrecognized result and information relating to the generation of a voicecommand corresponding to the collected audio data or the removal of aspecific voice command. The audio data that the audio module 130collects, as mentioned above, is transmitted to the server device 200and is speech-recognized by the electronic device 100. For example, whenthe electronic device 100 is unable to connect to the server device 200,it performs speech recognition on the collected audio data.

According to an embodiment of the present disclosure, the audio module130 outputs information relating to voice command processing,information relating to a function execution according to voice commandprocessing, and information relating to voice command update (forexample, a generation of a new voice command or a change or deletion ofan existing voice command). The above-mentioned information output ofthe audio module 130 may be omitted according to a user setting.

The display module 140 provides at least one screen interface (or a userinterface) relating to the management of the electronic device 100. Forexample, the display module 140 may output a lock screen, a turn-offscreen in a sleep mode state, a standby screen, a menu screen, etc.According to an embodiment of the present disclosure, the display module140 outputs a screen according to a specific function execution (forexample, a voice search function). The display module 140 outputs ascreen relating to a voice search function when the voice searchfunction is executed. When a microphone collects specific audio data,the display module 140 may output a screen relating to the transmissionto the server device 200 of the collected audio data, a screen relatingto audio analysis data reception from the server device 200, and ascreen relating to the update of a voice command by the received audioanalysis data. When audio data corresponding to a specific voice commandis collected, the display module 140 outputs a function execution screencorresponding to a corresponding voice command.

According to an embodiment of the present disclosure, the display module140 outputs a virtual keypad screen relating to a character inputcorresponding to a voice command. The display module 140 may output alist screen relating to stored voice commands and a screen relating tovoice command editing. The list screen relating to voice commands mayinclude at least one voice command and information on function items tobe performed when each voice command is inputted. The display module 140may output an information screen for candidate recognition modelsrelating to voice commands. Information on candidate recognition modelsmay include audio feature data (for example, data such as audiofrequency characteristics or time domain characteristics), speechrecognition data (for example, data such as characters obtained throughspeech recognition), function execution data (for example, a specificfunction item executed according to audio data), and information on aweight (for example, the number of times that the same audio data iscollected).

The storage module 150 stores information relating to the management ofthe electronic device 100, for example, an operating system, app dataaccording to a specific function execution, and the like. The storagemodule 150 may store data relating to a voice command providingfunction. For example, the storage module 150 may store audio data thatthe microphone of the audio module 130 collects. The storage module 150may store audio analysis data that the server device 200 provides incorrespondence to the transmitted audio data. In relation to this, thestorage module 150 may store a voice command generation table. Thestorage module 150 may store an app relating to a voice search function.The storage module 150 may store various apps to be executed by a voicecommand. The voice command generation table stored in the storage module150 may be updated by collected audio data, received audio analysisdata, and update information that the server device 200 provides.

The bus 170 may support a signal flow between each of components of theelectronic device 100. For example, the bus 170 may deliver audio datathat the audio module 130 collects to the control module 160 or maydeliver the audio data to the communication interface 110 according to acontrol of the control module 160. Additionally, the bus 170 may deliveraudio analysis data, received through the communication interface 110,to at least one of the storage module 150 and the control module 160.

The control module 160 may perform the transmission and processing ofdata relating to the management of the electronic device 100. Thecontrol module 160 may perform the transmission and processing of acontrol signal relating to the management control of the electronicdevice 100. In relation to a voice command providing function support,the control module 160 may be implemented as shown in FIG. 2.

FIG. 2 is a block diagram of the control module 160 and the storagemodule 150 according to an embodiment of the present disclosure.

Referring to FIG. 2, the storage module 150 of the electronic device 100according to an embodiment of the present disclosure includes a voicecommand generation table 50, a candidate recognition model 60, arecognition model 70, and a voice command 80.

The voice command generation table 50 includes audio feature data 51,speech recognition data 53, function execution data 55, and a weight 57.The audio feature data 51, the speech recognition data 53, and thefunction execution data 55 included in the voice command generationtable 50 may be collected based on audio analysis data that the serverdevice 200 provides. According to an embodiment of the presentdisclosure, the audio feature data 51 and the speech recognition data 53may be provided by an analysis of the electronic device 100. In relationto this, the electronic device 100 may further include a speechrecognition algorithm (for example, an algorithm for performing speechrecognition on audio data to output the audio data as text) and an audiofeature analysis module (for example, a module for extracting theacoustic feature of audio data, for example, spectrum information ofaudio data). Additionally, the control module 160 of the electronicdevice 100 may perform a control to generate and store functionexecution data 55 by mapping a speech recognition result into a functionexecuted on the electronic device 100.

The audio feature data 51 may be data on an audio feature (including afrequency or time axis area feature value such as Mel Frequency CepstralCoefficients (MFCC), Linear Prediction Coefficients (LPC), Line SpectralPairs (LSP), autocorrelation, power spectrum, pitch, etc.) for specificaudio data (for example, audio data that a user speaks). The audiofeature data 51 may include at least one audio feature (or a sound wavefrequency feature) included in each of at least one word, word-phrase,clause, phrase, sentence, paragraph, and page. The audio feature data 51may be data into which an audio feature is mapped for each audio data.The audio feature data 51 on each audio feature may be received from theserver device 200 and stored. Alternatively, the audio feature data 51may be detected by the electronic device 100 and stored.

The speech recognition data 53 may be speech recognized textinformation. The control module 160 of the electronic device 100transmits specific audio data, collected when a user speaks, to theserver device 200 through the communication interface 110. The controlmodule 160 receives a speech recognition result (for example, text)corresponding to specific audio data and stores it in the storage module150. The speech recognition data 53 may include a text mapped intospecific audio data.

The function execution data 55 includes function execution informationof the electronic device 100 mapped into specific audio data. Accordingto an embodiment of the present disclosure, the function execution data55 includes specific function execution information of the electronicdevice 100, which is obtained by analyzing audio data that the serverdevice 200 receives from the electronic device 100. According to anembodiment of the present disclosure, the function execution data 55 isdata that the electronic device 100 maps concerning specific functionexecution information executed by the collected audio data.

The weight 57 is defined based on information on the number of timesthat audio data relating to each of the audio feature data 51, thespeech recognition data 53, and the function execution data 55 arecollected and a collection time, the frequency of use of a specific appexecuted by audio data, and a usage time of a specific app. According toan embodiment of the present disclosure, the weight 57 may have arelatively large value corresponding to the number of times that eachaudio data is collected. According to an embodiment of the presentdisclosure, the weight 57 may have a relatively larger value for arecent time at which audio data is collected. According to an embodimentof the present disclosure, the weight 57 may have a relatively largevalue corresponding to the number of times that audio data is collectedwithin a set predetermined period. The weight 57 may be used forgenerating the candidate recognition module 60 or the recognition model70 and generating the voice command 80 according thereto.

For example, the collected audio data may be the following informationspoken in English: “Hello, how are you doing?” (first collected audiodata 1), “Show me the nearest restaurants.” (second collected audio data2), “Is it going to rain tomorrow?” (third collected audio data 3), “Howdo I get to the nearest subway station?” (fourth collected audio data4), “Show me the nearest restaurants.” (fifth collected audio data 5),“What is the stock price of Samsung Electronics?” (sixth collected audiodata 6), “Is it going to rain tomorrow?” (seventh collected audio data7), “Set an alarm for 6 am on Monday.” (eighth collected audio data 8),“I feel like having an ice-cream.” (ninth collected audio data 9), and“Show me the nearest restaurants.” (tenth collected audio data 10). Thecontrol module 160 may configure a voice command table as shown in Table1 below with respect to the audio data. Table 1 illustrates a table ofthe audio feature data 51, the speech recognition data 53, the functionexecution data 55, and the weight 57 for collected audio data.

TABLE 1 Audio Speech Function Weight feature data recognition dataexecution data 3 2, 5, 10 Show me the Open Map nearest restaurants.(Local search) 2 3, 7 Is it going to rain Weather for tomorrow? currentlocation 1 1 Hello, how are you doing? Chatbot response 1 4 How do I getto the Open Map nearest subway station? (Navigation) 1 6 What is thestock price QnA of Samsung Electronics? 1 8 Set an alarm for Alarm 6 amon Monday. 1 9 I feel like having Open Map an ice-cream. (Local search)

The candidate recognition model 60 may be candidate models preparedbefore the generation of the recognition model 70. When specific audiodata satisfies a specific predetermined specific condition (for example,at least one of the predetermined number of collections, collectionwithin a specific predetermined specific time, the frequency of use of aspecific app executed by audio data, and a usage time of a specificapp), the candidate recognition model 60, for example, may be generatedbased on the audio feature data 51, the speech recognition data 53, andthe function execution data 55 corresponding to corresponding audiodata. When the specific audio data does not satisfy a specificpredetermined specific condition (for example, at least one of whenthere is no audio data collection during a specific predeterminedspecific period and when the frequency of use of a specific app executedby audio data or a usage time is less than a predetermined value), thecandidate recognition model 60 relating to the specific audio data maybe removed. According to an embodiment of the present disclosure, theprocessing operation for the candidate module 60 in a voice commandproviding function of the electronic device 100 may be omitted. In thiscase, the candidate recognition module 60 may not be stored in thestorage module 150.

The recognition module 70 is comparison information corresponding to thevoice command 80. The recognition module 70 may include informationmapped into each voice command 80. According to an embodiment of thepresent disclosure, the recognition model 70 may include at least one ofthe audio feature data 51 and the speech recognition data 53corresponding to the specific voice command 80. According to anembodiment of the present disclosure, when audio data satisfying apredetermined specific condition is collected, the recognition model 70is generated based on the voice command generation table 50corresponding to the corresponding audio data. According to anembodiment of the present disclosure, if the recognition model 70 doesnot satisfy a specific predetermined specific condition, it is removed.During the management of the candidate recognition model 60, some of thecandidate recognition models 60 that satisfy a specific predeterminedspecific condition among the candidate recognition models 60 may beconverted into the recognition model 70.

The voice command 80 may be mapped into each recognition model 70 andstored. The voice command 80 may be mapped into the function executiondata 55. When a new recognition model 70 is generated, the new voicecommand 80 may be added. When the recognition model 70 is removed, thevoice command 80 may be removed. At least one voice command 80 among thevoice commands 80 may not be removed and may be maintained according toa setting regardless of an additional defined condition. The voicecommand 80 may be a command used for a voice shortcut function. Forexample, if audio data corresponding to the voice command 80 iscollected, the control module 160 may perform a control to execute afunction mapped into the voice command 80.

The control module 160 includes an audio data processing module 161, arecognition model processing module 163, and a voice command processingmodule 165.

The audio data processing module 161 controls the collection andprocessing of audio data. For example, the audio data processing module161 may perform a control to activate a microphone when a voice searchfunction is activated. The audio data processing module 161 may performa control to transmit audio data that a microphone collects to theserver device 200. The audio data processing module 161 may control anaudio analysis data reception corresponding to audio data that theserver device 200 provides. The audio data processing module 161 mayextract the audio feature data 51, the speech recognition data 53, andthe function execution data 55 from the received audio analysis data.The audio data processing module 161 may update each data stored in thestorage module 150 on the basis of the extracted data.

According to an embodiment of the present disclosure, the audio dataprocessing module 161 maps the audio feature data 51 in relation to thecollected audio data. For example, when receiving the audio feature data51 for audio data such as “camera,” “weather,” “news,” “stockinformation,” “please call mom,” and so on from the server device 200,the audio data processing module 161 maps the received audio featuredata 51 into each audio data and stores them.

According to an embodiment of the present disclosure, the audio dataprocessing module 161 maps the audio feature data 51 for one word ofaudio data such as “camera” and stores it. According to an embodiment ofthe present disclosure, the audio data processing module 161 maps audiofeature data for each word of a three-word phrase such as “please callmother” into a corresponding character and stores them as one audiofeature data 51. The audio feature data 51 may have a predeterminederror range by a situation or environment in which a user speaks or auser's physical change. For example, an audio feature for “please callmother” may have a predetermined difference value according to aspeaking place (for example, an open area, a confined place, a placehaving noise of more than a predetermined value, a place with adifferent barometric pressure, and the like). The audio data processingmodule 161 may map audio features within a predetermined error rangeinto audio features for one audio data and may store a mapping result asthe audio feature data 51. According to an embodiment of the presentdisclosure, even if audio data is configured with a similar sentence,the server device 200 or the electronic device 100 may classify asentence including another word as different audio features. Forexample, the audio data processing module 161 may classify audio datacorresponding to “please call mother” and audio data corresponding to“please call sister” as different audio feature data and store them.

According to an embodiment of the present disclosure, the audio dataprocessing module 161 extracts speech recognition data and audio featuredata for the received audio data by using a pre-stored speechrecognition algorithm and an audio feature extraction module accordingto a specific situation (for example, a voice search function isperformed in a situation where the electronic device 100 is unable toestablish a communication channel with the server device 200) orpredetermined schedule information. In relation to this, the audio dataprocessing module 161 may include a speech recognizer or speechrecognition processor relating to audio data speech recognition. Forexample, the audio data processing module 161 may include a speechrecognizer (for example, a voice command extractor) for determiningwhether audio data relates to a voice shortcut function (for example,S-Voice, Siri, etc.) or what function is to be executed in a voiceshortcut function execution state. The audio data processing module 161may update the speech recognition data 53 and the audio feature data 51stored in the storage module 150 by using the extracted data. The audiodata processing module 161 may check a function execution state afterspeech recognition and may update the function execution data 55 on thebasis of the checked function execution information.

The recognition model processing module 163 manages at least one of thecandidate recognition model 60 and the recognition model 70. Accordingto an embodiment of the present disclosure, the recognition modelprocessing module 163 performs a control to generate a new candidaterecognition model 60 on the basis of the weight 57 of analysis data ofaudio data that the electronic device 100 collects. The recognitionmodel processing module 163 may change the candidate recognition model60 into the recognition model 70 according to a specific condition afterchanging a score of the candidate recognition model 60 in relation tothe collected audio data. The recognition model processing module 163may generate a new recognition model 70 by changing the candidaterecognition model 60 into the recognition model 70 in correspondence toa specific condition. When a new recognition model 70 is generated, therecognition model processing module 163 may generate a voice command 80corresponding to the recognition model 70. Alternatively, a voicecommand 80 may be generated automatically based on analysis data ofaudio data contributed to the generation of the recognition model 70.According to an embodiment of the present disclosure, the recognitionmodel processing module 163 may remove the candidate recognition model60 according to a specific condition. Additionally, when removing thespecific recognition model 70, the recognition model processing module163 may remove a voice command 80 corresponding thereto.

According to an embodiment of the present disclosure, when theelectronic device 100 manages a large vocabulary recognition processor(or device), speech recognition performance is possible based on a voicecommand list. Correspondingly, the recognition model processing module163 may be integrated into the voice command processing module 165 sothat they may be configured as one module. Similarly, the electronicdevice 100 may support voice command processing on the basis of at leastone of a voice command 80 and a recognition model 70. For example, theelectronic device 100 may map audio data and a voice command 80 withoutrecognition model management and may support voice command processing onthe basis of the mapping result. Alternatively, the electronic device100 may support recognition model based function processing by mappingaudio data into a recognition model 70 and mapping the mappedrecognition model 70 into a specific function.

The voice command processing module 165 determines whether audio datathat the electronic device 100 collects corresponds to a voice command80. If the collected audio data corresponds to a voice command 80, thevoice command processing module 165 performs a control to execute aspecific function mapped into the voice command 80. During thisoperation, the voice command processing module 165 may determine asimilarity by mutually comparing the recognition model 70 and thecollected audio data. The voice command processing module 165 may detectthe recognition model 70 of which similarity to the collected audio datais more than a predetermined value and may check a function item of thevoice command 80 mapped into the recognition model 70.

As mentioned above, the electronic device 100 according to an embodimentof the present disclosure may collect audio analysis data of audio dataobtained in real time, at a predetermined period, or during specific appexecution. The electronic device 100 may generate a new voice command 80or update a voice command 80 on the basis of the audio analysis data.The electronic device 100 may support the generation and management of avoice command 80 corresponding to an app that a user uses frequently orheavily or a heavily used function.

FIG. 3 is a block diagram of a server device 200 according to anembodiment of the present disclosure.

Referring to FIG. 3, a server device 200 according to an embodiment ofthe present disclosure includes a server communication module 210, anantenna 212, a server storage module 250, and a server control module260.

The server communication module 210 may establish a communicationchannel with the network 300 and may establish a communication channelin correspondence to the connection of the electronic device 100. Theserver communication module 210 may receive, from the electronic device100, audio data corresponding to audio data that a user speaks. Thecollected audio data may be delivered to at least one of the serverstorage module 250 and the server control module 260. The servercommunication module 210 may transmit audio analysis data to theelectronic device 100 according to a control of the server controlmodule 260. According to an embodiment of the present disclosure, theserver communication module 210 may transmit, to the electronic device100, a voice command 80 and voice command update information relating tothe specific electronic device 100.

The server storage module 250 stores a program and data relating to avoice command providing function. For example, the server storage module250 may store an Automatic Speech Recognition (ASR) algorithm 251 and avoice command database 253. The ASR 251 may include an algorithmsupporting speech recognition for audio data that the electronic device100 transmits. The voice command database 253 may include information onvoice commands 80 for each electronic device. According to an embodimentof the present disclosure, the server storage module 250 may store anaudio data analysis program. The audio data analysis program mayinclude, for example, an audio data collection routine (for example,programmable information designed to execute a specific function, asincluding an instruction or an instruction set, a function, syntax, atemplate, class, etc.), a data processing routine, and a processing datatransmission routine.

The server control module 260 controls the performance of at least oneof the connection of the electronic device 100, the analysis of audiodata and analysis data provision, and voice command management. Theserver control module 260 may include a voice command related block 201as shown in FIG. 4. According to various embodiments of the presentdisclosure, the voice command related block 201 may be established inthe electronic device 100 and managed.

FIG. 4 is a block diagram relating to voice command processing accordingto an embodiment of the present disclosure.

Referring to FIG. 4, the voice command related block 201 includes avoice search manager 280 and a voice command manager 290. At least oneblock in the voice command related block 201 may be included in aconfiguration of the server control module 260.

The voice search manager 280 includes an audio data collection module281, a data processing module 283, and a processing data transmissionmodule 285.

The audio data collection module 281 performs a control so that theserver communication module 210 establishes a communication channel withthe electronic device 100. For example, when the server communicationmodule 210 receives a connection request of the electronic device 100,the audio data collection module 281 controls communication connectionprocessing in correspondence thereto. The audio data collection module281 collects audio data that the electronic device 100 provides inaddition to the identification information of the electronic device 100.The audio data collection module 281 delivers audio data to the dataprocessing module 283.

The data processing module 283 performs analysis on the audio data thatthe audio data collection module 281 delivers. The data processingmodule 283 extracts audio feature data, speech recognition data, andfunction execution data from the collected audio data. In relation tothis, the data processing module 283 may include an analysis module foranalyzing the frequency spectrum of audio data. The data processingmodule 283 may manage the ASR algorithm 251 stored in the storage module150 in relation to the speech recognition data extraction. The dataprocessing module 283 may collect text information on audio data throughthe management of the ASR 251.

The data processing module 283 may manage a Natural LanguageUnderstanding (NLU) module in relation to function execution dataextraction. The NLU module may extract natural languages from audio dataand performance requested function execution information by combiningthe extracted natural languages. In relation to this, the dataprocessing module 283 may check type information of a function installedon the electronic device 100 by comparing the identification informationof the electronic device 100 and the type information of a pre-storedinstallation function for each electronic device. Alternatively, theserver device 200 may request function type information from theelectronic device 100 to provide it to the data processing module 283.The data processing module 283 may extract function executioninformation on the basis of an analysis result of natural languagesincluded in audio data and pre-stored device specific function typeinformation (for example, a database where at least one natural languageis mapped into each function is mapped). For example, the dataprocessing module 283 may extract function execution informationcorresponding to the collected audio data by checking an intent forquery and specific various conditions, which are identified through ananalysis of natural languages. The extracted function executioninformation is provided to the processing data transmission module 285.

The processing data transmission module 285 delivers audio feature data,speech recognition data, and function execution information that thedata processing module 283 provides, to the electronic device 100providing audio data. In relation to this, the processing datatransmission module 285 may receive information on connection with theelectronic device 100 from the audio data collection module 281.According to an embodiment of the present disclosure, the processingdata transmission module 285 delivers audio feature data, speechrecognition data, and function execution information to the voicecommand manager 290.

The voice command manager 290 includes a processing data collectionmodule 291 and a voice command management module 293.

The processing data collection module 291 receives audio feature data,speech recognition data, and function execution information that thevoice search manager 280 provides. The processing data collection module291 may store the received audio feature data, speech recognition data,and function execution information in the server storage module 250 ofFIG. 3 so that they may be identified by each electronic device 100 oreach user. The processing data collection module 291 of FIG. 4 maydetermine a weight for the collected audio feature data, speechrecognition data, and function execution information. For example, theprocessing data collection module 291 may determine a weight (or score)for each data on the basis of information on the number of times thatspecific audio data is received and a time at which specific audio datais received. According to an embodiment of the present disclosure, ifaudio data is received relatively frequently within a predeterminedperiod, the processing data collection module 291 may set a relativelyhigh weight. Additionally, the processing data collection module 291 mayincrease (or decrease or maintain) a predetermined weight according tothe number of receptions within a predetermined period. According to anembodiment of the present disclosure, the processing data collectionmodule 291 may set a relatively high weight of audio data that isreceived relatively recently based on the current. Alternatively, theprocessing data collection module 291 may assign a predetermined weight(for example, the size of a minus weight is increased, which isinterpreted to reduce the importance as a time interval increases).

If a set weight is greater than a specific condition, the processingdata collection module 291 generates a voice command 80 of audio datacorresponding to a corresponding weight. The processing data collectionmodule 291 delivers the generated voice command 80 to the voice commandmanagement module 293. According to an embodiment of the presentdisclosure, the processing data collection module 291 delivers weightchange information to the voice command management module 293. Accordingto an embodiment of the present disclosure, the processing datacollection module 291 may generate or update a voice command 80according to the generation and management methods of the candidaterecognition model 60 and the recognition model 70 described with theelectronic device 100.

The voice command management module 293 receives the generated voicecommand 80 from the processing data collection module 291. The voicecommand management module 293 may receive information on weight changefrom the processing data collection module 291. The voice commandmanagement module 293 manages the voice command database 253 on thebasis of the received voice command 80 and weight change information.For example, the voice command management module 293 may add a newlygenerated voice command 80 to the voice command database 253 for eachelectronic device. Alternatively, if the weight of a voice command 80relating to specific audio data is changed and becomes less than aspecific condition, the voice command management module 293 may removethe voice command 80 from the voice command database 253. When a newvoice command 80 is generated in relation to the specific electronicdevice 100, the voice command management module 293 may deliver thenewly generated voice command information to the electronic device 100.Additionally, when an existing voice command 80 is removed, the voicecommand management module 293 may deliver information on the removalsituation as voice command update information to the electronic device100.

According to an embodiment of the present disclosure, functions of theprocessing data collection module 291 and the voice command managementmodule 293 may be performed on the electronic device 100, except for aspeech recognition function. For example, if a set weight (or score) isgreater than a specific condition, the electronic device 100 maygenerate a voice command 80 of audio data corresponding to acorresponding weight. The electronic device 100 may generate or update avoice command 80 according to the generation and management methods ofthe candidate recognition model 60 and the recognition model 70. Whenreceiving information on weight change, the electronic device 100 maymanage the storage of a voice command 80 on the basis of the receivedvoice command 80 and weight change information. For example, theelectronic device 100 may add a newly generated voice command 80 to adatabase storing a voice command 80. When a voice command 80 is removedfrom the database, the electronic device 100 may output an alarm forthis through the audio module 130 or the display module 140.

According to an embodiment of the present disclosure, the electronicdevice 100 may include an audio module for collecting audio data and acontrol module for updating a voice command 80 set to execute a specificfunction of the electronic device 100 through voice when specific audiodata is collected, on the basis of at least one of audio feature data ofthe audio data, speech recognition data obtained by speech recognitionof the audio data, and function execution data executed in relation tothe audio data.

According to an embodiment of the present disclosure, the control module160 may update the weight of at least one of pre-stored audio featuredata, the speech recognition data, and the function execution data incorrespondence to the audio data collection and may generate the voicecommand 80 if the weight satisfies a specific condition.

According to an embodiment of the present disclosure, if the weightsatisfies the specific condition, the control module 160 may generate acandidate recognition model 60 and if the weight of the candidaterecognition model 60 satisfies a specific condition in relation to theaudio data, may change the candidate recognition model 60 into arecognition model 70 corresponding to the voice command 80.

According to an embodiment of the present disclosure, the control module160 may register a new voice command 80 corresponding to the recognitionmodel 70 changed from the candidate recognition model 60.

According to an embodiment of the present disclosure, the control module160 may update the weight of at least one of a candidate recognitionmodel 60 and recognition model 70 having no relation with the collectedaudio data and may remove at least one of a specific candidaterecognition model 60 and a specific recognition model 70 incorrespondence to the updated weight.

According to an embodiment of the present disclosure, the control module160 may remove a registered voice command 80 in correspondence to therecognition model 70 removal.

According to an embodiment of the present disclosure, the control module160 may control the display of at least one of the audio feature data51, the speech recognition data 53, the function execution information55, and the voice command 80.

According to an embodiment of the present disclosure, the control module160 may control at least one of the weight update of the audio featuredata 51 on the basis of the frequency of occurrence of the audio featuredata, the weight update of the speech recognition data 53 on the basisof the frequency of occurrence of the speech recognition data, and theweight update of the function execution data 55 using at least one ofwhether to execute a specific function of the function execution data 55and a specific function execution duration time of the functionexecution data 55.

According to an embodiment of the present disclosure, the control module160 may control a communication interface 110 for transmitting the audiodata to a server device 200 and receiving, from the server device 200,at last one of the audio feature data 51, the speech recognition data53, and the function execution data 55.

According to an embodiment of the present disclosure, the control module160 may control a communication interface 110 for receiving, from theserver device 200, a voice command 80 generated based on at least one ofthe audio feature data 51, the speech recognition data 53, and thefunction execution data 55.

FIG. 5 is a flowchart of a voice command providing method according toan embodiment of the present disclosure.

Referring to FIG. 5, a voice command providing method according to anembodiment of the present disclosure allows the control module 160 ofthe electronic device 100 to perform a management or standby function inoperation 501. For example, the control module 160 may output a standbyscreen, a lock screen, or a specific function execution screen accordingto a set schedule or an input control.

In operation 503, the control module 160 checks whether there is anevent occurrence relating to voice command support function activation.For example, the control module 160 may check whether there is a settingrelating to a voice command support function. Alternatively, the controlmodule 160 may check whether an input event relating to a voice commandsupport function occurs.

If there is a voice command support function activation setting or avoice command support function activation event occurs in operation 503,the control module 160 checks whether there is an event occurrencerelating to voice search function activation in operation 505. Forexample, the control module 160 may check the occurrence of an event forselecting a function icon relating to a voice search function and anevent for requesting an app execution relating to a voice searchfunction.

According to an embodiment of the present disclosure, when a voicesearch function is set to be provided by default, the control module 160checks a corresponding setting. If there is no voice command supportfunction activation setting or event occurrence in operation 503 or ifthere is no voice search function activation related setting or eventoccurrence in operation 505, the control module 160 controls thefunction execution corresponding to the occurred event type in operation507. For example, the control module 160 may execute a specific appaccording to an event type or may maintain a previous state (forexample, a sleep mode state, a lock screen state, a standby screenoutput state, etc.) of the electronic device 100.

If there is a voice search function activation related setting or eventin operation 505, the control module 160 controls audio data collectionand transmission in operation 509. The control module 160 may activate amicrophone of the audio module 130 and collect audio data.

According to an embodiment of the present disclosure, a voice searchfunction may be performed separately from a voice shortcut function. Forexample, the control module 160 may drive a specific search recognizer(for example, a search processor) in relation to voice search functionexecution. The control module 160 may drive a specific functionperformer (for example, an S-Voice processor) in relation to a voiceshortcut function. Alternatively, according to an embodiment of thepresent disclosure, the control module 160 of the electronic device 100may simultaneously process a voice search function and a voice shortcutfunction through a function performer. If audio data is collected, thecontrol module 160 may transmit corresponding audio data to the serverdevice 200. In relation to this, the control module 160 may establish acommunication channel with the server device 200. The server device 200may generate audio analysis data for the received audio data andtransmit it to the electronic device 100.

In operation 511, the control module 160 receives audio analysis dataincluding at least one of speech recognition data 53, audio feature data51, and function execution data 55. In operation 513, the control module160 may perform voice command processing on the basis of the receivedaudio analysis data. According to an embodiment of the presentdisclosure, the control module 160 may update the weights of the speechrecognition data 53, the audio feature data 51, and the functionexecution data 55, which are stored in the storage module 150, on thebasis of the received audio analysis data. When audio analysis dataincludes analysis data for a plurality of words or word-phrases duringthis operation, the control module 160 may update (for example, increasea weight count) the weight of at least one of the audio feature data 51and the speech recognition data 53 including a plurality of words orword-phrases. Alternatively, the control module 160 may update theweight of at least one of the speech recognition data 53 and audiofeature data 51 corresponding to at least part of a plurality of words.Alternatively, the control module 160 may update the weight of at leastone of the speech recognition data 53 and audio feature data 51corresponding to each of a plurality of words.

According to an embodiment of the present disclosure, in the case of theaudio feature data 51, the same information may have different valuesaccording to a collection environment of audio data. For example, firstinformation (for example, audio data corresponding to “camera”)collected from a noisy place and the first information collected from aless noisy place may have audio feature data of differentcharacteristics. The control module 160 may apply an error caused by acollection environment during the update operation of the audio featuredata 51. Alternatively, the control module 160 may store and manageaudio data as the audio feature data 51 of a different characteristic.According to an embodiment of the present disclosure, during a speechrecognition operation, the same value may be extracted based on a noisecanceling operation and an estimation operation through a similaritycomparison of a speech recognition database. The speech recognition data53 may be collected as the same value with respect to the same audiodata (for example, audio data corresponding to “camera”).

According to an embodiment of the present disclosure, the control module160 may update the weight of the function execution data 55 stored inthe storage module 150 on the basis of function execution data 55included in the received audio analysis data. Alternatively, the controlmodule 160 may update (for example, assign a high weight or increase aweight as an execution duration time increases) the weight of thefunction execution data 55 on the basis of the execution and executionduration time of an app or corresponding function executed by functionexecution data 55.

If at least one of the audio feature data 51, speech recognition data53, and function execution data 55 satisfies a specific condition (forexample, a condition that it is greater than a predetermined weight setfor generating a voice command 80), the control module 160 may generateand manage a voice command 80 for corresponding audio data.

According to an embodiment of the present disclosure, if the serverdevice 200 is designed in a form of providing a voice command, thecontrol module 160 may directly receive voice command update informationfrom the server device 200. In this case, the control module 160 mayperform the update of the voice command 80 in the storage module 150 byusing the voice command update information received from the serverdevice 200.

In operation 515, the control module 160 checks whether there is afunction termination related event occurrence. If the functiontermination related event occurs in operation 515, the control module160 may control at least one function termination of a voice searchfunction and a voice command support function. If there is no functiontermination related event occurrence in operation 515, the controlmodule 160 returns to operation 505 and performs the subsequentoperations again. The control module 160 may support the collection ofaudio data that a user uses frequently, and the command processingaccording thereto by managing a voice search function continuously (forexample, an “always on” mode).

FIG. 6 is a flowchart of a voice command providing method according toan embodiment of the present disclosure.

Referring to FIG. 6, the voice command providing method performs themanagement or standby function of the control module 160 in operation601. For example, the control module 160 may perform a control tomaintain the electronic device 100 in a sleep mode or output a standbyscreen. The control module 160 may provide a setting screen relating tovoice search function activation or output a voice search functionrelated function icon or menu to the display module 140. Alternatively,the control module 160 may allocate a function button (for example, ahome key) relating to voice search function execution.

In operation 603, the control module 160 checks whether there is a voicesearch function activation related event occurrence or setting. If thereis no voice search function activation related setting or eventoccurrence, the control module 160 proceeds to operation 605 andcontrols a function execution corresponding to an occurred event type.For example, the control module 160 may control the execution of a soundsource playback function, a broadcast reception function, and so onaccording to the event type. Alternatively, if there is no eventoccurrence, the control module 160 may perform a control to maintain afunction management state (for example, a sleep mode state, a specificfunction screen output state, and a state in which a specific functionis performed in background) of operation 601.

If an event relating to voice search function activation occurs inoperation 603, the control module 160 performs audio data collection andtransmission in operation 607. In operation 609, the control module 160receives speech recognition data, audio feature data, and functionexecution data from the server device 200.

In operation 611, the control module 160 checks whether there is acandidate recognition model 60 relating to the received data. If thereis a candidate recognition model 60 in operation 611, the control module160 may perform candidate recognition model test and voice commandprocessing in operation 613. For example, the control module 160 mayperform the weight update of the candidate recognition model 60.Additionally, the control module 160 may perform new voice commandgeneration according to the weight update of the candidate recognitionmodel 60.

If there is no candidate recognition model 60 in operation 611, thecontrol module 160 checks whether a candidate recognition modelingcondition is satisfied in operation 615. For example, the control module160 may check whether at least one of the audio feature data 51, speechrecognition data 53, and function execution data 55 updated by audioanalysis data satisfies a specific condition or they all satisfy aspecific condition. If the candidate recognition modeling condition issatisfied in operation 615, the control module 160 performs candidaterecognition model generation in operation 617. If the candidaterecognition modeling condition is not satisfied in operation 615, thecontrol module 160 skips operation 617.

In operation 619, the control module 160 checks whether there is anevent occurrence relating to function termination. If the functiontermination related event occurs in operation 619, the control module160 controls voice search function termination. If there is no functiontermination related event occurrence in operation 619, the controlmodule 160 returns to operation 603 and performs the subsequentoperations again.

FIG. 7 is a flowchart of a voice command provision related candidaterecognition model processing method according to an embodiment of thepresent disclosure.

Referring to FIG. 7, in relation to a candidate recognition modelprocessing method, when audio data is collected, the control module 160performs a candidate recognition model test in operation 701. Forexample, the control module 160 may perform the update of the weight (orscore) of audio feature data 51, speech recognition data 53, andfunction execution data 55 stored in the storage module 150 on the basisof the received audio analysis data. During this operation, the controlmodule 160 may perform the weight update of at least one of the audiofeature data 51, speech recognition data 53, and function execution data55 relating to the specific candidate recognition model 60. During thisoperation, the control module 160 may reduce the weight of anothercandidate recognition model 60 in correspondence to a weight increase ofthe specific candidate recognition model 60.

In operation 703, the control module 160 checks whether a recognitionmodel or voice command generation condition is satisfied. For example,when the weight of the specific candidate recognition model 60 isgreater than a predetermined value, the control module 160 changes acorresponding candidate recognition model 60 into a recognition model70. If the recognition model 70 or voice command generation condition issatisfied in operation 703, the control module 160 changes the candidaterecognition model 60 into the recognition model 70 in operation 705.Additionally, the control module 160 may control the voice commandgeneration or registration corresponding to the recognition modelgeneration or registration. For example, the control module 160 maygenerate the voice command 80 on the basis of the speech recognitiondata 53 and function execution data 55 corresponding to the changedrecognition model 70.

If the voice command generation condition is not satisfied in operation703, the control module 160 checks whether a candidate recognition modelremoval condition is satisfied in operation 707. If the candidaterecognition model removal condition is satisfied in operation 707, thecontrol module 160 removes the candidate recognition model 60. If thecandidate recognition model removal condition is not satisfied inoperation 707, the control module 160 skips operation 709. For example,if a weight change of a candidate recognition model 60 is between ageneration condition and a removal condition, the control module 160 mayperform the weight update of a specific candidate recognition model 60.

According to an embodiment of the present disclosure, the control module160 performs model removal on the recognition model 70 additionally orsubstitutionally in addition to the candidate recognition model 60. Forexample, the control module 160 removes the recognition model 70 storedin the storage module 150, for example, the recognition model 70corresponding to a voice command generated through the candidaterecognition model 60 or the recognition model 70 corresponding to avoice command generated by a user input, according to the frequency ofuse and the last use time.

In operation 513, the control module 160 performs voice commandprocessing on the basis of the received audio analysis data. If there isa voice command 80, the control module 160 may update (for example,weight increase) the weight of a corresponding recognition model 70.During this operation, the control module 160 may update (for example,weight decrease) the weight of the voice command 80 having no relationto audio analysis data. If there is a recognition model 70 having aweight less than a predetermined value, the control module 160 mayremove a corresponding recognition model 70. When the recognition model70 is removed, a corresponding voice command 80 may be removed.

According to an embodiment of the present disclosure, the voice commandproviding method may include collecting audio data and updating a voicecommand 80 set to execute a specific function of an electronic devicethrough a voice command 80 when specific audio data is collected, on thebasis of at least one of audio feature data of the audio data, speechrecognition data obtained by speech-recognizing the audio data, andfunction execution data executed in relation to the audio data.

According to an embodiment of the present disclosure, the method mayinclude updating the weight of at least one of pre-stored audio featuredata 51, the speech recognition data 53, and the function execution data55 in correspondence to the audio data collection and generating thevoice command 80 if the weight satisfies a specific condition.

According to an embodiment of the present disclosure, the updating ofthe voice command 80 may include generating a candidate recognitionmodel 60 if the weight satisfies the specific condition, updating theweight of the candidate recognition model 60 in relation to the audiodata, and changing the candidate recognition model 60 into a recognitionmodel 70 corresponding to the voice command 80 if the updated weightsatisfies the specific condition.

According to an embodiment of the present disclosure, the updating ofthe voice command 80 may include newly registering a voice command 80corresponding to the recognition model 70 changed from the candidaterecognition model 60.

According to an embodiment of the present disclosure, the updating ofthe voice command 80 may include updating the weight of at least one ofa candidate recognition model 60 and recognition model 70 having norelation with the collected audio data and removing at least one of aspecific candidate recognition model 60 and a specific recognition model70 in correspondence to the weight update.

According to an embodiment of the present disclosure, the updating ofthe voice command 80 may include removing a registered voice command 80corresponding to the recognition model 70 removal.

According to an embodiment of the present disclosure, the method mayfurther include outputting at least one of the audio feature data 51,the speech recognition data 53, the function execution data 55, and thevoice command 80.

According to an embodiment of the present disclosure, the updating ofthe weight may include updating the weight of the audio feature data 51in correspondence to the frequency of occurrence of the audio featuredata 51, updating the speech recognition data 53 in correspondence tothe frequency of occurrence of the speech recognition data 53, andupdating the weight of the function execution data 55 on the basis ofwhether to execute a specific function of the function execution data 55and a specific function execution duration time of the functionexecution data 55.

According to an embodiment of the present disclosure, the method mayfurther include transmitting the audio data to a server device 200 andreceiving, from the server device 200, at last one of the audio featuredata 51, the speech recognition data 53, and the function execution data55.

According to an embodiment of the present disclosure, the method mayfurther include receiving, from the server device 200, a voice commandgenerated based on at least one of the audio feature data 51, the speechrecognition data 53, and the function execution data 55.

FIG. 8 is an illustration of a user interface relating to a voicecommand provision according to an embodiment of the present disclosure.

Referring to FIG. 8, the control module 160 performs registration of anew voice command corresponding to specific audio data collection.Accordingly, the display module 150 may output information for guidingvoice command registration as shown in a screen 801. For example, when auser inputs the audio data “show me,” the control module 160 may receiveaudio analysis data by transmitting corresponding audio data to theserver device 200 or may collect audio analysis data by using a speechrecognition algorithm and an audio analysis module. The control module160 may update the audio feature data 51, speech recognition data 53,and function execution data 55 for the collected audio data “show me.”If a voice command generation condition is satisfied during an updateoperation, the control module 160 may generate the audio data “show me”as a new voice command 80. The display module 140 may display thefunction execution information “open Map” 810 mapped into the voicecommand “show me” 820 together. That is, the display module 140 mayperform a notification for a voice shortcut function.

According to an embodiment of the present disclosure, when a new voicecommand 80 is generated or an event corresponding to a voice commandlist view occurs, the control module 160 may perform a control to outputa voice command list screen to the display module 140 as shown in ascreen 803. The voice command list, for example, may include “Camera”831, “Call Mom” 833, and “open Map” 835 corresponding to functionexecution data 55 “Action.” A voice command “Voice” corresponding to thefunction execution data 55 may include “Camera” and “Picture” 832corresponding to the “Camera” 831. Accordingly, when a user pronounces“Camera” or “Picture,” the control module 160 may perform a control toexecute a camera function. The voice command “Voice” may include “Mom,”“Mother,” and “Mommy” 834 corresponding to “Call Mom” 833. The voicecommand “Voice” may include “show me” 836 corresponding to “open Map”835.

According to an embodiment of the present disclosure, if the candidaterecognition model 60 is updated or an event relating to the view of thecandidate recognition model 60 occurs, the control module 160 mayprovide a screen interface as shown in a screen 805. A candidaterecognition model view screen, for example, may include a functionexecution data 55 “Action” 851, a speech recognition data 53“Transcription” 853, and a weight “Score Weight” 855.

FIG. 9 is a block diagram of an electronic device according to anembodiment of the present disclosure

Referring to FIG. 9, the electronic device 900, for example, mayconfigure all or part of the above-mentioned electronic device 100 shownin FIG. 1. Referring to FIG. 9, the electronic device 900 includes atleast one Application Processor (AP) 910 (for example, the controlmodule 160 of FIG. 1), a communication module 920 (for example, thecommunication interface 110 of FIG. 1), a Subscriber IdentificationModule (SIM) card 924, a memory 930 (for example, the storage module 150of FIG. 1), a sensor module 940, an input device 950 (for example, theinput module 120 of FIG. 1), a display module 960 (for example, thedisplay module 140 of FIG. 1), an interface 970, an audio module 980(for example, the audio module 130 of FIG. 1), a camera module 991, apower management module 995, a battery 996, an indicator 997, and amotor 998.

The AP 910 may control a plurality of hardware or software componentsconnected to the AP 910 by executing an operating system or anapplication program. The AP 910 may perform various data processing andcalculations with multimedia data. The AP 910 may be implemented with aSystem on Chip (SoC), for example. According to an embodiment of thepresent disclosure, the AP 910 may further include a Graphics ProcessingUnit (GPU).

According to an embodiment of the present disclosure, various modulesrelating to the above-mentioned voice command provision may beimplemented in the AP 910. The AP 910 may control the collection ofaudio data, the transmission of audio data, the reception of audioanalysis data, the update of the storage module 150 on the basis ofaudio analysis data, the update of the candidate recognition model 60and the recognition model 70, and the processing and management of thevoice command 80 by performing a control of related modules.

According to an embodiment of the present disclosure, various modulesrelating to the voice command provision may be separately disposed in atleast one of a Communication Processor (CP) and an AP 910. During thisoperation, modules that a CP controls may be disposed to allow directcommunication in the same chipset as the CP or to be connected to the CPthrough an external interface in terms of hardware.

According to an embodiment of the present disclosure, various modulesrelating to the voice command provision may be disposed in a CP. A CPmay control related modules. In this case, the CP may be communicablyconnected to a cellular communication module and a WiFi module. Inrelation to this, when each of the configurations is connected via asystem bus in the same chipset, when an AP is in a power saving mode,they are communicably connected to each other. When each of theconfigurations is configured with a different chipset, they areconnected through an external interface, and communication may bepossible without passing through an AP in terms of hardware.

The communication module 920 may perform data transmission/receptionbetween the electronic device 900 (for example, the electronic device100) and the server device 200 connected via network. According to anembodiment of the present disclosure, the communication module 920 mayinclude a cellular module 921, a WiFi module 923, a Bluetooth (BT)module 925, a Global Positioning System (GPS) module 927, a Near FieldCommunication (NFC) module 928, and a Radio Frequency (RF) module 929.

The cellular module 921 may provide voice calls, video calls, textservices, or Internet services through a communication network (forexample, Long Term Evolution (LTE), LTE Advanced (LTE-A), Code DivisionMultiple Access (CDMA), Wideband CDMA (WCDMA), Universal MobileTelecommunications System (UMTS), Wireless Broadband (WiBro), or GlobalSystem for Mobile communications (GSM)). The cellular module 921 mayperform a distinction and authentication operation on an electronicdevice in a communication network by using a SIM card 924, for example.According to an embodiment of the present disclosure, the cellularmodule 921 may perform at least part of a function that the AP 910provides. For example, the cellular module 921 may perform at least partof a multimedia control function.

According to an embodiment of the present disclosure, the cellularmodule 921 may further include a Communication Processor (CP).Additionally, the cellular module 921 may be implemented with SoC, forexample. As shown in FIG. 9, components such as the cellular module 921(for example, a CP), the memory 930, or the power management module 995are separated from the AP 910, but according to an embodiment of thepresent disclosure, the AP 910 may be implemented to include some of theabove-mentioned components (for example, the cellular module 921).

According to an embodiment of the present disclosure, the AP 910 or thecellular module 921 (for example, a CP) may load instructions or data,which are received from a nonvolatile memory or at least one of othercomponents connected thereto, into a volatile memory and then mayprocess them. Furthermore, the AP 910 or the cellular module 921 maystore data received from or generated by at least one of othercomponents in a nonvolatile memory.

According to an embodiment of the present disclosure, the cellularmodule 921 may be included in the communication interface 110 describedwith reference to FIG. 1. The cellular module 921 may establish acommunication channel with the server device 200 during an operation forperforming the voice command processing of the electronic device 100.Additionally, the cellular module 921 may transmit audio data that theelectronic device 1000 collects and may receive audio analysis data.According to an embodiment of the present disclosure, the cellularmodule 921 may receive a voice command and voice command updateinformation from the server device 200.

Each of the WiFi module 923, the BT module 925, the GPS module 927, andthe NFC module 928 may include a processor for processing datatransmitted/received through a corresponding module. The WiFi module 923and the BT module 925 may be included in the communication interface110. The GPS module 927 may be included in the communication interface110.

Although the cellular module 921, the WiFi module 923, the BT module925, the GPS module 927, and the NFC module 928 are shown as separateblocks in FIG. 9, according to an embodiment of the present disclosure,some (for example, at least two) of the cellular module 921, the WiFimodule 923, the BT module 925, the GPS module 927, and the NFC module928 may be included in one Integrated Circuit (IC) or an IC package. Forexample, at least some (for example, a CP corresponding to the cellularmodule 921 and a WiFi processor corresponding to the WiFi module 923) ofthe processors respectively corresponding to the cellular module 921,the WiFi module 923, the BT module 925, the GPS module 927, and the NFCmodule 928 may be implemented with one SoC.

According to an embodiment of the present disclosure, the WiFi module923 may be included in the communication interface 110 described withreference to FIG. 1. The WiFi module 923 may establish a communicationchannel between the electronic device 100 and the server device 200. TheWiFi module 923 may transmit at least one of the identificationinformation of audio data and the electronic device 100 or the functiontype information of the electronic device 100 to the server device 200.The WiFi module 923 may receive at least one of audio analysis data andvoice command update information from the server device 200.

The RF module 929 may be responsible for data transmission, for example,the transmission of an RF signal. The RF module 929 may include atransceiver, a Power Amplifier Module (PAM), a frequency filter, or aLow Noise Amplifier (LNA). Additionally, the RF module 929 may furtherinclude components for transmitting/receiving electromagnetic waves infree space in a wireless communication, for example, conductors orconductive wires. Although the cellular module 921, the WiFi module 923,the BT module 925, the GPS module 927, and the NFC module 928 share oneRF module 929 shown in FIG. 9, according to an embodiment of the presentdisclosure, at least one of the cellular module 921, the WiFi module923, the BT module 925, the GPS module 927, and the NFC module 928 mayperform the transmission/reception of an RF signal through an additionalRF module.

The SIM card 924 may be inserted into a slot formed at a specificposition of an electronic device. The SIM card 924 may include uniqueidentification information (for example, an Integrated Circuit CardIdentifier (ICCID)) or subscriber information (for example, anInternational Mobile Subscriber Identity (IMSI)). According to anembodiment of the present disclosure, the SIM card 924 may be a partialconfiguration of the memory 930. When the SIM card 924 is inserted intoa slot, the AP 910 may perform the initialization operation of the SIMcard 924.

The memory 930 (for example, the storage module 150) may include aninternal memory 932 or an external memory 934. The internal memory 932may include at least one of a volatile memory (for example, DynamicRandom Access Memory (DRAM), Static RAM (SRAM), Synchronous DRAM(SDRAM)) and a non-volatile memory (for example, One Time ProgrammableRead Only Memory (OTPROM), Programmable ROM (PROM), Erasable andProgrammable ROM (EPROM), Electrically Erasable and Programmable ROM(EEPROM), mask ROM, flash ROM, NAND flash memory, and NOR flash memory).According to an embodiment of the present disclosure, the internalmemory 932 may be a Solid State Drive (SSD).

The external memory 934 may further include a flash drive, for example,a Compact Flash (CF) drive, a Secure Digital (SD) memory card, a MicroSD (Micro-SD) memory card, a Miniature SD (Mini-SD) memory card, anextreme Digital (xD) memory card, or a memory stick. The external memory934 may be functionally connected to the electronic device 900 throughvarious interfaces. According to an embodiment of the presentdisclosure, the electronic device 900 may further include a storagedevice (or a storage medium) such as a hard drive.

The sensor module 940 measures physical quantities or detects anoperating state of the electronic device 900, thereby converting themeasured or detected information into electrical signals. The sensormodule 940 may include at least one of a gesture sensor 940A, a gyrosensor 940B, a barometric pressure sensor 940C, a magnetic sensor 940D,an acceleration sensor 940E, a grip sensor 940F, a proximity sensor940G, a color sensor 940H (for example, a Red, Green, Blue (RGB)sensor), a biometric sensor 940I, a temperature/humidity sensor 940J, anillumination sensor 940K, and an Ultra Violet (UV) light sensor 940M.Additionally or alternatively, the sensor module 940 may include anElectronic nose (E-nose) sensor, an ElectroMyoGraphy (EMG) sensor, anElectroEncephalogram (EEG) sensor, an ElectroCardioGram (ECG) sensor, anInfraRed (IR) sensor, an iris sensor, or a fingerprint sensor. Thesensor module 940 may further include a control circuit for controllingat least one sensor therein.

According to an embodiment of the present disclosure, the sensor module940 may collect operation related sensor signals of the electronicdevice 900. The sensor signals that the sensor module 940 collects maybe delivered to the AP 910. The AP 910 may perform voice commandprocessing on the basis of the delivered sensor signals. For example,the sensor signals delivered from the sensor module 940 may be used as atrigger signal relating to the activation of at least one of a voicecommand providing function and a voice search function.

At least one sensor included in the sensor module 940 may be activatedin relation to the management of the electronic device 100. For example,a sensor signal of a sensor for detecting the grip of the electronicdevice 100 may be used as a sensor signal relating to voice searchfunction activation. Additionally, a sensor signal of a grip detectionsensor may be used as a sensor signal relating to microphone activation.The grip detection sensor may be deactivated in correspondence to avoice search function deactivation.

The input device 950 may include a touch panel 952, a (digital) pensensor 954, a key 956, or an ultrasonic input device 958. The inputdevice 950 may include the input module 120 of FIG. 1.

The touch panel 952 may recognize a touch input through at least one ofcapacitive type, resistive type, infrared type, or ultrasonic typemethods, for example. Additionally, the touch panel 952 may furtherinclude a control circuit. In the case of the capacitive type method,both direct touch and proximity recognition are possible. The touchpanel 952 may further include a tactile layer. In this case, the touchpanel 952 may provide a tactile response to a user. According to anembodiment of the present disclosure, the touch panel 952 may generate atouch event relating to the execution of at least one of a voice commandproviding function and a voice search function. For example, the touchpanel 952 may provide a touch event for removing at least one of acandidate recognition model 60 and a recognition model 70 and requestingto change a specific candidate recognition model 60 into a recognitionmodel 70 in relation to a screen interface. According to an embodimentof the present disclosure, the touch panel 952 may generate a touchevent for activating or deactivating a screen automatic conversionfunction or selecting the type of a function to be applied to a screenautomatic conversion function.

The (digital) pen sensor 954 may be implemented through a method similaror identical to that of receiving a user's touch input or an additionalsheet for recognition. The key 956 may include a physical button, anoptical key, or a keypad, for example. At least one key, for example, ahome key, in the key 956 may generate a key event relating to voicesearch function activation or a key event relating to voice commandproviding function activation. The ultrasonic input device 958, as adevice checking data by detecting sound waves through a microphone (forexample, a microphone 988) in the electronic device 900, may providewireless recognition through an input tool generating ultrasonicsignals. According to an embodiment of the present disclosure, theelectronic device 900 may receive a user input from an external device(for example, a computer or a server) connected thereto through thecommunication module 920.

The display module 960 (for example, the display module 140) may includea panel 962, a hologram device 964, or a projector 966. The panel 962may include a Liquid-Crystal Display (LCD) or an Active-Matrix OrganicLight-Emitting Diode (AM-OLED). The panel 962 may be implemented to beflexible, transparent, or wearable, for example. The panel 962 and thetouch panel 952 may be configured with one module. The hologram 964 mayshow three-dimensional images in the air by using the interference oflight. The projector 966 may display an image by projecting light onto ascreen. The screen, for example, may be placed internally or externallyto the electronic device 900. According to an embodiment of the presentdisclosure, the display 960 may further include a control circuit forcontrolling the panel 962, the hologram device 964, or the projector966.

The interface 970 may include a High-Definition Multimedia Interface(HDMI) 972, a Universal Serial Bus (USB) 974, an optical interface 976,or a D-subminiature (D-sub) connector 978, for example.Additionally/alternately, the interface 970 may include a MobileHigh-dimension Link (MHL) interface, a Secure Digital (SD)card/Multi-Media Card (MMC) interface, or an Infrared Data Association(IrDA) standard interface.

The audio module 980 (for example, the audio module 130 of FIG. 1)converts sound into electrical signals and vice versa. The audio module980 may process sound information inputted/outputted through a speaker982, a receiver 984, an earphone 986, or a microphone 988. According toan embodiment of the present disclosure, the audio module 130 disposedin the electronic device 100 may collect audio data. Additionally, theaudio module 130 may output audio data relating to function execution bya voice command.

The camera module 991, as a device for capturing a still image and avideo, may include at least one image sensor (for example, a frontsensor or a rear sensor), a lens, an Image Signal Processor (ISP), or aflash (for example, a Light-Emitting Diode (LED) or a xenon lamp).

The power management module 995 manages the power of the electronicdevice 900. According to an embodiment of the present disclosure, thepower management module 995 may control the power supply of at least onedevice element of the electronic device 100. For example, when thebattery power of the electronic device 100 is less than a setting value,the power management module 995 may cut off the power supply of specificdevice elements (for example, a sensor module 940, a communicationmodule 920 for establishing a direct communication channel, a GPS module927, and so on). The power management module 995 may change the powersupply of device elements activated in relation to a communicationfunction of the electronic device 100 according to a communicationconnection release with the server device 200. The power managementmodule 995 may include a Power Management IC (PMIC), a charger IC, or abattery gauge, for example.

The PMIC may be built in an IC or an SoC semiconductor, for example. Acharging method may be classified into a wired method and a wirelessmethod. The charger IC may charge a battery and may prevent overvoltageor overcurrent flow from a charger. According to an embodiment of thepresent disclosure, the charger IC may include a charger IC for at leastone of a wired charging method and a wireless charging method. Thewireless charging method includes, for example, a magnetic resonancemethod, a magnetic induction method, or an electromagnetic method. Anadditional circuit for wireless charging, for example, a circuit such asa coil loop, a resonant circuit, or a rectifier circuit, may be added.

The battery gauge measures the remaining battery power amount of thebattery 996, or a voltage, current, or temperature of the battery 396during charging. The battery 996 may store or generate electrical powerand may supply electrical power to the electronic device 900 by usingthe stored or generated electrical power. The battery 996, for example,may include a rechargeable battery or a solar battery.

The indicator 997 may display a specific state of the electronic device900 or part thereof (for example, the AP 910), for example, a bootingstate, a message state, or a charging state. According to an embodimentof the present disclosure, the indicator 997 may display a voice commandproviding function state, a voice search function execution state, and avoice command based function execution available state. The indicator997 may display a connection state of the voice command provision basedserver device 200 The motor 998 may convert electrical signals intomechanical vibration. The electronic device 900 may include a processingdevice (for example, a GPU) for mobile TV support. A processing devicefor mobile TV support may process media data according to the standardssuch as Digital Multimedia Broadcasting (DMB), Digital VideoBroadcasting (DVB), or media flow.

Each of the above-mentioned components of the electronic deviceaccording to an embodiment of the present disclosure may be configuredwith at least one component and the name of a corresponding componentmay vary according to the kind of an electronic device. An electronicdevice according to an embodiment of the present disclosure may includeat least one of the above-mentioned components, may not include some ofthe above-mentioned components, or may further include anothercomponent. Additionally, some of components in an electronic deviceaccording to an embodiment of the present disclosure are configured asone entity, so that functions of previous corresponding components areperformed identically.

The term “module” used in various embodiments of the present disclosure,for example, may refer to a unit including a combination of at least oneof hardware, software, and firmware. The terms “module,” “unit,”“logic,” “logical block,” “component,” or “circuit” may beinterchangeably used. The term “module” may refer to a minimum unit orpart of an integrally configured component. The term “module” may referto a minimum unit performing at least one function or part thereof. The“module” may refer to a device implemented mechanically orelectronically. For example, the term “module” according to variousembodiments of the present disclosure may refer to at least one of anApplication-Specific Integrated Circuit (ASIC) performing specificoperations, Field-Programmable Gate Arrays (FPGAs), or aprogrammable-logic device, all of which are known or will be developedin the future.

According to an embodiment of the present disclosure, at least part of adevice (for example, modules or functions thereof) or a method (forexample, operations) according to the present disclosure, for example,as in a form of a programming module, may be implemented using aninstruction stored in non-transitory computer-readable storage media.When at least one processor (for example, the processor 210) executes aninstruction, it may perform a function corresponding to the instruction.The non-transitory computer-readable storage media may include thememory 930, for example. At least part of a programming module may beimplemented (for example, executed) by the Application Processor 910,for example. At least part of a programming module may include a module,a program, a routine, sets of instructions, or a process to perform atleast one function, for example.

The non-transitory computer-readable storage media may include magneticmedia such as a hard disk, a floppy disk, and a magnetic tape, opticalmedia such as a Compact Disc Read Only Memory (CD-ROM) and a DigitalVersatile Disc (DVD), magneto-optical media such as a floptical disk,and a hardware device especially configured to store and perform aprogram instruction (for example, a programming module) such as a ReadOnly Memory (ROM), a Random Access Memory (RAM), and a flash memory.Additionally, a program instruction may include high-level language codeexecutable by a computer using an interpreter in addition to machinereadable code generated by a complier. The hardware device may beconfigured to operate as at least one software module to perform anoperation of an embodiment of the present disclosure and vice versa.

A module or a programming module according to an embodiment of thepresent disclosure may include at least one of the above-mentionedcomponents, may not include some of the above-mentioned components, ormay further include another component. Operations performed by a module,a programming module, or other components according to an embodiment ofthe present disclosure may be executed through a sequential, parallel,repetitive or heuristic method. Additionally, some operations may beexecuted in a different order or may be omitted, or other operations maybe added.

The terms “include,” “comprise,” “have,” “may include,” “may comprise”and “may have” used herein indicate disclosed functions, operations, orthe existence of elements but do not exclude other functions, operationsor elements. Additionally, in an embodiment of the present disclosure,the terms “include,” “comprise,” “including,” or “comprising,” specify aproperty, a region, a fixed number, an operation, a process, an elementand/or a component but do not exclude other properties, regions, fixednumbers, operations, processes, elements and/or components.

In an embodiment of the present disclosure, the expressions “A or B” or“at least one of A or/and B” may include all possible combinations ofitems listed together. For instance, the expressions “A or B” or “atleast one of A and/or B” may include A, B, or both A and B.

The terms such as “1^(st)” “2^(nd)” “first,” “second,” and the like usedherein may refer to modifying various different elements of variousembodiments of the present disclosure, but do not limit the elements.For instance, such expressions do not limit the order and/or importanceof corresponding components. The expressions may be used to distinguishone element from another element. For example, a first component may bereferred to as a second component and vice versa without departing fromthe scope and spirit of the present disclosure.

In the disclosure below, when one part (or element, device, etc.) isreferred to as being “connected” to another part (or element, device,etc.), it should be understood that the former can be “directlyconnected” to the latter, or “connected” to the latter via anintervening part (or element, device, etc.). In contrast, when anelement is referred to as being “directly connected” or “directlycoupled” to another element, there are no intervening elements present.

In an embodiment of the present disclosure, terms used in the presentdisclosure are used to describe specific embodiments, and are notintended to limit the scope of the present disclosure. The terms of asingular form may include plural forms unless they have a clearlydifferent meaning in the context.

Unless otherwise indicated herein, all the terms used herein, whichinclude technical or scientific terms, may have the same meanings thatare generally understood by a person skilled in the art. In general, theterms defined in the dictionary should be considered to have the samemeanings as the contextual meanings of the related art, and, unlessclearly defined herein, should not be understood abnormally or as havingexcessively formal meanings.

According to an embodiment of the present disclosure, electronic devicesmay include at least one of smartphones, tablet Personal Computers(PCs), mobile phones, video phones, electronic book (e-book) readers,desktop PCs, laptop PCs, netbook computers, Personal Digital Assistants(PDAs), Portable Multimedia Players (PMPs), Moving Picture Experts GroupAudio Layer 3 (MP3) players, mobile medical devices, cameras, andwearable devices (for example, Head-Mounted-Devices (HMDs) such aselectronic glasses, electronic apparel, electronic bracelets, electronicnecklaces, electronic appcessories, electronic tattoos, and smartwatches).

According to an embodiment of the present disclosure, an electronicdevice may be smart home appliances. The smart home appliances mayinclude at least one of, for example, televisions, Digital Video Disk(DVD) players, audio players, refrigerators, air conditioners, cleaners,ovens, microwave ovens, washing machines, air cleaners, set-top boxes,TV boxes (for example, Samsung HomeSync™, Apple TV™ or Google TV™), gameconsoles, electronic dictionaries, electronic keys, camcorders, andelectronic picture frames.

According to an embodiment of the present disclosure, an electronicdevice may include at least one of various medical devices (for example,Magnetic Resonance Angiography (MRA) devices, Magnetic Resonance Imaging(MM) devices, Computed Tomography (CT) devices, medical imaging devices,ultrasonic devices, etc.), navigation devices, Global Positioning System(GPS) receivers, Event Data Recorders (EDRs), Flight Data Recorders(FDRs), vehicle infotainment devices, marine electronic equipment (forexample, marine navigation systems, gyro compasses, etc.), avionics,security equipment, vehicle head modules, industrial or householdrobots, financial institutions' Automatic Teller Machines (ATMs), andvendors' Point of Sale (POS) devices.

In an embodiment of the present disclosure, an electronic device mayinclude at least one of part of furniture or buildings/structuressupporting call forwarding service, electronic boards, electronicsignature receiving devices, projectors, and various measuringinstruments (for example, water meters, electricity meters, gas meters,or radio signal measuring instruments). An electronic device accordingto an embodiment of the present disclosure may be one of theabove-mentioned various devices or a combination thereof. Additionally,an electronic device according to an embodiment of the presentdisclosure may be a flexible device. Furthermore, it is apparent tothose skilled in the art that an electronic device according to anembodiment of the present disclosure is not limited to theabove-mentioned devices.

According to an embodiment of the present disclosure, fast functionprocessing is supported by converting audio data that a user usesfrequently into a voice command.

Additionally, according to an embodiment of the present disclosure, whenaudio data is converted into a voice command, additional server devicemanagement is unnecessary so that a wireless data resource is notnecessary.

Additionally, according to an embodiments of the present disclosure,when voice commands are updated based on an audio data managementhistory, the management of unnecessary voice commands is reduced andvoice commands for a function that a user wants to frequently use aremanaged efficiently.

Also, embodiments of the present disclosure disclosed in the presentdisclosure and the accompanying drawings are provided as examples todescribe the technical content and facilitate understanding but are notintended to limit the scope of the present disclosure. Accordingly, itshould be construed that besides the embodiments of the presentdisclosure listed herein, all modifications or modified forms derivedbased on the technical ideas of the present disclosure are included inthe scope of the present disclosure, as defined by the appended claimsand their equivalents.

What is claimed is:
 1. A portable communication device, comprising: adisplay; at least one microphone; a memory; and a processor operablyconnected to the display, the at least one microphone and the memory,wherein the processor is configured to: display guide information, viathe display, in response to a user input, the guide informationincluding a first display object related to guide a user voice input forgeneration of a new voice command and a second display object related toat least one application executed by the new voice command via theportable communication device; receive audio data corresponding to thefirst display object from a user through the at least one microphone;generate the new voice command corresponding to the audio data; andstore, in the memory, the new voice command corresponding to thereceived audio data and mapping information indicating that the newvoice command and the at least one application are mapped.
 2. Theportable communication device of claim 1, wherein the processor isfurther configured to display the mapping information after generationof the new voice command.
 3. The portable communication device of claim1, wherein the first display object includes textual informationindicating the user voice input related to the new voice command.
 4. Theportable communication device of claim 1, wherein the second displayobject includes textual information describing at least portion offunction of the at least one application.
 5. The portable communicationdevice of claim 1, wherein the processor is further configured totransmit the audio data to a server device and receive audio analysisdata from the server device.
 6. The portable communication device ofclaim 5, wherein the processor is further configured to generate the newvoice command based on the audio analysis data received from the serverdevice.
 7. The portable communication device of claim 1, wherein theprocessor is further configured to display a voice command listincluding at least the new voice command.
 8. The portable communicationdevice of claim 7, wherein the processor is further configured todisplay at least one function item associated with the new voice commandin the voice command list.
 9. The portable communication device of claim7, wherein the processor is further configured to display a virtualbutton to delete at least the new voice command.
 10. The portablecommunication device of claim 7, wherein the processor is furtherconfigured to: when a plurality of applications to be executed accordingto the new voice command are configured and the audio data correspondingto the new voice command is received, execute the plurality ofapplications corresponding to the new voice command.
 11. A method foroperating a new voice command by a portable communication device, themethod comprising: displaying guide information, via a display, inresponse to a user input, the guide information including a firstdisplay object related to generation of a new voice command and a seconddisplay object related to at least one application executed by the newvoice command via the portable communication device; receiving audiodata corresponding to the first display object from a user through atleast one microphone; generating the new voice command corresponding tothe audio data; and storing, in a memory, the new voice commandcorresponding to the received audio data and mapping informationindicating that the new voice command and the at least one applicationare mapped.
 12. The method of claim 11, wherein the first display objectincludes textual information indicating speech related to the new voicecommand; and wherein the second display object includes textualinformation describing at least a portion of a function of the at leastone application.
 13. The method of claim 11, further comprising:displaying a voice command list including at least the new voicecommand.
 14. The method of claim 13, wherein displaying the voicecommand list comprises: displaying at least one function item associatedwith the new voice command in the voice command list.
 15. The method ofclaim 13, wherein displaying the voice command list comprises:displaying a virtual button to delete at least the new voice command.16. The method of claim 13, further comprising: when a plurality ofapplications to be executed according to the new voice command areconfigured and the audio data corresponding to the new voice command isreceived, executing the plurality of applications corresponding to thenew voice command.